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Abstract. In the analysis of elastic-scattering experimental data, optical-model parameters 
(usually, depths of real and imaginary potentials) are fitted and conclusions are drawn analyzing 
their variations at bombardment energies close to the Coulomb barrier (threshold anomaly). 
The judgement about the shape of this variation (related to the physical processes producing 
this anomaly) depends on these fitted values but the robustness of the conclusions strongly 
depends on the uncertainties with which these parameters are derived. We will show that 
previous published studies have not used a common criterium for the evaluation of the parameter 
uncertainties. In this work, a study of these uncertainties is presented, using conventional 
statistic tools as well as bootstrapping techniques. As case studies, these procedures are applied 
to re-analyze detailed elastic-scattering data for the 12 C + 208 Pb and the 6 Li + 80 Se systems. 


1. Introduction 

In the study of elastic scattering of atomic nuclei at low energies there has been a long-lasting 
interest in the so-called threshold anomaly (TA [!)). For the case of tightly bound nuclei, this 
phenomenon, related to the closure of reaction channels, consists in a decrease of the depth of 
imaginary part of the optical potential at bombarding energies below the Coulomb barrier Vb- 
Due to the causality-related dispersion relation (DR [1]) linking the real and imaginary parts 
of optical potentials, the depth of the real part also varies strongly, peaking around Vb (see 
Refs. [21EUU). In the case of weakly bound projectiles, the coupling to nonelastic channels (e.g. 
breakup) generates a repulsive polarization potential [2] that can produce either the absence of 
TA (no TA [5] (6, 7] [8]) or the so-called breakup threshold anomaly (BTA [Zl|9],[8]), in which the 
imaginary potential increases while approaching Vb and, conversely, there is a reduction on the 
real part of the potential mm- 

For an unambiguous determination of the kind of anomaly, the variation of the optical- 
model parameter values as a function of the energy must be evaluated taking into account 
their uncertainties (hereafter called parameter uncertainties ), which must be derived from the 
experimental angular distribution data and their own uncertainties (hereafter called experimental 
uncertainties). However, publications on the subject apply different, sometimes non-rigorous 
criteria for the estimation of the parameter uncertainties or do not consider uncertainties at all. 
Here, a study of the parameter uncertainties is presented, using conventional statistic tools as 
well as the bootstrap technique m- It is hoped that these methods will help to achieve a better 


determination of the parameters of interest in the characterization of the TA. In section [2] we 
discuss mathematical and physical issues that influence the determination of uncertainties when 
adjusting optical-model parameters using experimental angular distributions, in section [3] the 
12 C + 208 Pb and the 6 Li + 80 Se systems will be reanalyzed and their uncertainties evaluated 
with different techniques. Finally, in section [5] we make our final remarks. 


2. The determination of optical-model parameter uncertainties 

In this section we will firstly consider the x 2 test H2.ll) since it is the most popular method to 
evaluate the optical-model parameter uncertainties, we will review the different % 2 criteria found 
in the literature (12.21) and finally we will consider the two techniques that we will apply to the 
case studies in the next section, namely: covariance ellipses m and bootstrap method (12.41) . 


2.1. The x 2 test 

Let us consider a series of experimental pairs Xi,yi(xi), where the y* values have an uncertainty 
A in (statistical, background substruction, etc.) which is assumed to be normally distributed. To 
compare these experimental data with a theoretical model that adjust the data with a function 
y = f(x ) taking into account the experimental uncertainties, we could use an adjusting program 
that minimizes the value of x 2 defined as 
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where N is the number of experimental points and Ri are the so-called residuals. The adjusting 
program should minimize the effective distance between the experimental results y^ and their 
theoretical estimation /(aq). The simplest case to study is the repetition of a measurement of 
a physical quantity (say a life-time or the speed of light) by several laboratory groups. The 
theoretical model f(xi) could be as simple as the construction of the best evaluated value of 
that physical quantity, e.g. the arithmetic or weighted average. In this simple case the expected 
X 2 should be close to N — 1, where N is the number of measurements. If not, procedures 
such as the proposed by Birge [12], 13j [T3] should be applied. In its original form, it applies 
for interlaboratory evaluations (external uncertainty) when x 2 /{N — 1) > 1 and consists in 
multiplying the experimental (internal) uncertainties by ^/x 2 /(A — 1). With the increased 
uncertainties a new, normalized value x 2 ' is obtained, here using N instead of N — 1 for large 
number of points: 


. 2/ A fo - /U,)] 2 A [i A fo - /te)] 2 , N ,N 

x k Ay . 2 k (vT^a *,) 1 k A »? w x \ 2> u 

We consider now cases in which the theoretical function / has k parameters a = (aq,..., a*), 
denoted from now on as /(aq|a), that should be adjusted to achieve the best fit of / to 
experimental data. It is a well-known rule mm that the uncertainty with which a single, 
uncorrelated parameter aj is adjusted, can be obtained varying this parameter around its 
optimum value aj® (while all others parameters are optimized) until the value of y 2 increments 
in one unit, i.e.: 

X 2 = X 2 o + l- (3) 

Here Xq denotes the minimum value of y 2 . For this rule to be valid the following conditions 
must apply: 

• The uncertainties of raw experimental data Ay* are properly determined. 










• There are no significant systematic errors. 

• The theoretical model is a true description of the data being studied. 

As consequence of the previous conditions the residuals Ri will follow a normal distribution 
with mean value (Ri) = 0 and variance aj i = l (we will denote this Ri ~ A7(0,1)) which implies 
Xq ~ v (although the reciprocal is not necessarily true). Here v is the number of degrees of 
freedom v = N — nj being rif the number of free parameters. In most of the cases rif = 2 and 
N > 20, thus v ~ IV and no significant difference arises from the use of N instead of v. 

As we will see in section 12.21 many data sets analyzed in the area of low-energy elastic 
scattering do not fulfil all the conditions previously mentioned, but the rule of eq. [3] is 
nevertheless applied. Hence the uncertainty of the obtained parameters is underestimated. For 
these cases, we will extend the procedure of Birge (eq. [2]) for the experimental adjustment of 
one or several parameters a of a theoretical function f(xi\a) in the following way: 

2/ = y' [Vi ~ fixj |oQ] 2 = X 2 f , 

(VXo/vAyi ) 2 (Xo/z') 


For the optimum set of parameters ccq we obtain 
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Now, with the experimental uncertainties Ay* scaled by the Birge factor yy^/V the rule of eq. 
[3] can be applied: 

X 2/ = X8 / + 1- (6) 

This does not imply that the experimental uncertainties Ay^ are effectively changed in fact the 
original ones should be reported. To avoid confusions we prefer to replace in eq. [6] with eq. 2] 
and [5] to obtain the equivalent rule 


X 2 = Xl + Xl/v ■ (7) 

In the case of adjusting several (even correlated) parameters the rule of eq. [Qshould be extended 
as x 2 = yfj + Ay 2 , where for two parameters and a 68% confidence level Ay 2 = 2.3. See Ref. [IT] 
(p. 815) for a table of Ay 2 for different confidence levels and number of adjustable parameters. 
In the more general case in which y^/V > 1 and several parameters are adjusted simultaneously 
eq. [7] is extended to 


X 2 = Xo + Ax 2 ', where Ay 2 ' = Ay 2 y \/v. (8) 

In the study of scattering angular distributions, the experimental data ( Xi,yi ) consist in angles 
and differential cross-sections ( 9i,dcri/dQ ). The theoretical model f(xi\a) can be either the 
calculated da(6i)/d£l using the phenomenological Woods-Saxon optical model or the microscopic 
models involving folding of nuclear densities with appropriated nucleon-nucleon potentials. In 
this work the Sao Paulo global microscopic potential (SPP [IBJU7]) is used with a\ = Nr and 
a 2 = Nj (depth of real and imaginary parts of the potential, respectively). 

2.2. Criteria used in previous works 

Table 1 presents a non-exhaustive list of experiments studying the TA, either with weakly or 
tightly bound projectiles. It can be seen that most studies use the standard rule y 2 < y ( 2 + 1 
(eq. [3]) to determine the uncertainties regardless of their y 2 /i^ value . We will show in the 







next section that due to parameter correlations, this rule gives too small uncertainties bars, 
even in the best case when x'o/% ~ 1, being even worse when x 2, /v 1. It is apparent that 
this problem has been recognized but not clearly acknowledged and, thus, many of the different 
criteria listed in Table 1 attempted to increase the x 2 A Xo + 1 limits. A good example of this 
can be seen in Ref. m Since their angular distribution data for the 12 C + 208 Pb system 
have an average value (Xo A') = 6, the usual criterium x 2 < Xo + 1 would have clearly been an 
underestimation of the parameter uncertainties and an extreme criterium x 2 < 2 \q was used, 
which, as we will show in section mi is an overestimation. In Fig.|T]we show the x 2 vs. Nr curve 
corresponding to our reanalysis using SPP of the 84.9 MeV angular distribution of Ref. [18] . 
The optimum fit is obtained applying a combination of grid, and steepest descent searching 
routines and gives: Nr q = 0.5738, Nj o = 0.5173, Xo = 198, X^/ u = 9.9. The covariance 
matrix, including the variance of each of the two parameters Nr and Nj and their covariance, 
is calculated using second derivatives calculated numerically around the minimum |15j . The 
parabolic approximation of the curve describing x 2 as a function of Nr is shown in Fig. |T]with 
dashed lines. Its expression is given by 

X 2 = —( n R ~ n Ro) 2 + Xo> (9) 

ff i 

where af is the variance of Nr. This variance determines the value of \Nr — Nrq\ that produces 
a change in one unit in the y 2 , as in eq. HOal The solid lines in Fig. [T] represent the values 
corresponding to a grid on Nr while Nj is optimized. It is seen that the parabolic approximation 
is quite good even at several o\ away from the minimum. Uncertainty limits corresponding to 
different criteria found in the literature are: 
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These equations are not meant to represent different confidence limits (CL) but different criteria. 
In the particular example of Fig. [T] <73 represents the 68 % CL for the adjustment of the single 
parameter Nr, considered as uncorrelated with Nj, while <74 represents the 68 % CL for the 
simultaneous adjustment of the correlated Nr and Nj. In this case, since Xo/ 1 ' = 9-9, ct\ and 
(72 do not represent 68 % CL. In the parabolic approximation of eq. E]it holds 

02 = V 2 Hai, a 3 = yjxl/vai, and <74 = ^ 2 . 2 >xl/v cri- (11) 

Perhaps, the great variety of criteria in Table 1 are due to the fact that in most cases the 
standard rule x 2 < Xo + 1 produces too small uncertainties. This turns to be evident when the 
optimum values of the parameters are in effect changed by their uncertainties: the corresponding 
change in the angular distributions is often indistinguishable from the optimum ones. 

2.3. Error ellipses 

One interesting example within low-energy nuclear physics of the use of error ellipses to estimate 
uncertainties for correlated parameters is presented in Ref. [39]. However, this has not been 
applied to take into account the correlation between the optical-model parameters. In fact, 
none of the works listed in Table |T] uses this technique. In our case the ellipses corresponding 
to the different limits previously mentioned are calculated as 

Ax 2 ' = (a - cko) T C' _ 1 (q: - a 0 ), 


( 12 ) 






Table 1. Different criteria used in the calculation of parameter uncertainties in the study of 
the threshold anomaly. 


Reference 


criterium 

Projectile 

Target 

(X 2 /N) 

conclusion 

Biswas 2008 

m 

Xo + Xo/ N 

6 Li 

64 Ni 

0.43 

No TA 




6 Li 

58 Ni 

0.45 

No conclusive 

Deshmuk 2011 

m 

Xo + 1 

6 Li 

112 Sn 

5.18 

No TA 




6 Li 

116 Sn 

12.2 

No TA 

Fernandez Niello 2007 

m 

Xo + 1 

6 Li 

27 A1 

No data 

No TA 

Figueira 2006 

El 

xg + i 

7 Li 

27 A1 

3.6 

No TA 

Figueira 2010 

m 

Xo + 1 

6 Li 

144 Sm 

2.51 

BTA 




7 Li 

144 Sm 

2.68 

No TA 

Figueira 2007 

m 

Xo + 1 

6 Li 

27 A1 

5.22 

No TA 

Fimiani 2012 

m 

xl +1 

6 Li 

80 Se 

1.05 

BTA 




7 Li 

80 Se 

1.00 

TA 

Garcia 2007 

m 

xl + N + 1 

6 He 

209 Bi 

2.2 

BTA 

Gomes 2004 

m 

xg + i 

9 Be 

27 A1 

No data 

No TA 

Gomes 2005 

m 

Xo + Xo/N 

9 Be 

64 Zn 

No data 

BTA 

Gomez Camacho 2007 

m 

no uncertainty bars 

9 Be 

64 Zn 

0.61 

BTA 

Gomez Camacho 2008 

m 

no uncertainty bars 

9 Be 

144 Sm 

0.61 

No TA 

Gomez Camacho 2010 

m 

Xo + ^ 

6 Li 

58 Ni 

0.61 

BTA 




7 Be 

58 Ni 

0.05 

BTA 




8 B 

58 Ni 

0.51/0.19 

BTA 

Keeley 1994 

m 

l-15x§ 

6 Li 

208 Pb 

2.16 

No TA 




7 Li 

2 0Spb 

1.53 

weak TA 

Kumawat 2008 

ED] 

1-5x1 

6 Li 

90 Zr 

0.82 

No TA 

Lubian 2003 

m 

X 0 + 1 

7 Li 

138 Ba 

No data 

BTA 

Maciel 1999 

m 

qualitative 

6 Li 

138 Ba 

No data 

No TA 




7 Li 

138 Ba 

No data 

TA 

Nagarajan 1985 

E3 

no uncertainty bars 

16 0 

208 Pb 

No data 

TA 

Pakou 2003 

m 

Not given 

6 Li 

28 Si 

No data 

No TA 

Pakou 2004 

E2] 

Not given 

7 Li 

28 Si 

No data 

No TA 

Santra 2001 

m 

2 Xo 

12 C 

208 Pb 

6.03 

TA 

Souza 2007 

ESI 

i-i xl 

6 Li 

59 Co 

No data 

TA or BTA 




7 Li 

59 Co 

No data 

TA 

Woolliscroft 2004 

EH 

1-15 xl 

9 Be 

208 Pb 

11 

TA 

Zadro 2009 

m 

xl +1 

6 Li 

64 Zn 

1.18 

No TA 
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Figure 1 . y 2 as a function of Nr for 12 C + 208 Pb at 84.9 MeV (Plots a) and b) show different 
scales of the axes). Different criteria for the uncertainty interval of Nr are shown: o\ ~ 0.0086, 
02 ~ 0.013, 03 ~ 0.0271, 04 « 0.041. The criterium applied in Ref. [18] gives 0 s an tra 2001 ~ 0.121. 


where Ay 2/ is defined in eq[ 8 l the covariance matrix C is calculated for each system and energy 
and a — «o represent deviations respect the optimum value of the parameters. 

Figure [2] shows three of such ellipses for the 12 C + 208 Pb angular distribution at 84.9 MeV 
corresponding to the 04, 03 and 04 limits for the determination of the standard uncertainty in 
both parameters. The limit 02 should be used in cases where (x 2 /V) ~ 1. In the cases were 
C\' 2 / 1 ') > 1) 04 should be used. We will show the error ellipses for all energies of both cases 
studied in Figs. [3]and[5j 

2-4- Bootstrap 

Bootstrap is one of the many resampling methods designed to go beyond regular statistic test. 
It creates a number Nr of synthetic data sets, each of them consisting on N data points 
selected randomly (with reposition) from the original data set of N points (it is desirable to 
have Nr N). On the average a fraction 1/e (about 37%) of the N points will be repeated 
ones (thus having more weight in the fitting procedure) and, consequently, 37% of the elements 
will not be included. Each synthetic data set is used to fit the parameters of interest. The 
standard deviation of the Nr values obtained for each parameter is a reliable estimation of 
its uncertainty. Hence, this procedure gauges the sensitivity of the fitted parameter to each 
individual data point by the simulation of Nr experiments in which the experimenter could 
have chosen to repeat the measurement of some of the data points at the cost of missing some 
others. The bootstrap method has been one of the techniques applied to the evaluation of the 
half-life of 198 Au in Ref. [40J . To the best of our knowledge, bootstrap techniques have not been 
applied yet to the calculation of nuclear potential parameters and their uncertainties. 

In Fig. [2] we show the resulting Nr,Nj points from the adjustment of Nr = 2200 synthetic 
angular distributions. The average and variance converged for Nr > 200. It is interesting to 
point out that 76% of the bootstrap points are enclosed by the 04 ellipse. 
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Figure 2. Plot a) shows the bootstrapped values (red points) and the ellipses described in 
section 12.31 (02 ellipses not shown for clarity). Histograms in b) and c) are the projection of 
bootstrapped points on the Nr and Nj axis respectively, while the full line shows the much 
narrower gaussian distribution with standard deviation o\ (% < Xq + 1) for comparison. 


3. Case studies 

In the first step to study the 12 C + 208 Pb and the 6 Li + 80 Se systems, the optimum Nr, Nj values 
are calculated as well as the corresponding residuals, covariance matrices and error ellipses. Since 
a condition of the analysis is the normality of the residuals, the Kolmogorov-Smirnov test has 
been applied. This statistical test evaluates the maximum difference between the empirical and 
reference (theoretical) cumulative distribution functions and yields the acceptance or rejection 
of a null hypothesis at a given confidence level [TT|. 

In our case, we compare to two different null hypothesis: i) the residuals follows a normal 
distribution with mean value (R) = 0 and variance cr 2 R = 1 , i.e. Hoi : Ri ~ A/"(0,1) and 
ii) the residuals follows a normal distribution but in this case with variance a R = Xo/ 1 ' he. 
Ho2:Ri~Ar(0,-x$/v). 

3.1. The 12 C + 20S Pb system 

As expected, the residuals of the angular distributions of each individual energy, as well as the 
residuals corresponding to all data taken together, follow Af(0, Xo/v) but do not follow Ah( 0 , 1 ). 
Fig. [3] shows the error ellipses corresponding to the limits <J\, and <74 of eq. [TO] (<^2 not shown 
for clarity) and points (Nr, Nj) representing the results from fitting bootstrapped data sets as 
explained in section ITT For all energies, Nr > 300. The numbers n\, 712, 713 and 714 indicate 
the number of these bootstrapped points inside each ellipse (as it has been shown in Fig. [2] 
expressed as a percentage of Nr). Except for the lowest and highest energies more than 50% of 
the bootstrapped points are enclosed inside the 0-4 ellipse. In general they extend beyond the last 
ellipse but keeping the same correlation. If cases c) and h) of this figure a group of points diverge 


















through the bootstrap technique for the 12 C + 208 Pb system. The analysis based on the ellipses 
is described in section 3.3. The uncertainty bars indicate the medium values of the parameter 
distribution and their standard deviations. 


from the main trend. The effect was traced to the influence of one single experimental point in 
both cases, been the divergent group part of a population in which that point is omitted. In 
Fig- HI the parameters and their uncertainties given by the bootstrap method is compared with 
the ones given by Ref. [18]. It is seen that even though our assigned uncertainties are smaller 
the character of a regular TA is maintained. 

3.2. 6 Li + 80 Se system 

Since in this experiment Xq/i' ~ 1 both null hypothesis almost coincide. The Kolmogorov- 
Smironov test indicates that residuals corresponding to all data taken together are normally 
distributed, and so are individual angular distributions for each energy, except for the data 
corresponding to 23 and 14.5 MeV. This reveals that for these two energies there is a subtle 
difference between experimental data and the theoretical model. Even though this difference is 
statistically significant, it would have remained unnoticed without this analysis. Normalization 
factors of around 1 . 6 % applied to these angular distributions are enough to make them pass the 
test, but this may require further analysis. Figure [5] shows the error ellipses and bootstrapped 
points as in Fig. [2j Here, more than 43% of the bootstraped points are enclosed inside the <74 
ellipse. The behavior of the parameters and their uncertainties given by the bootstrap limits is 
compared with the ones given by in Ref. [24] in Fig. [4] 
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Figure 4. Comparison between the dispersion relations reported in the original works and those 
obtained in the present analysis with the bootstrap technique a) for the 12 C + 208 Pb system and 
b) for the 6 Li + 80 Se system. The bootstrap results are slightly displaced in energy for clarity. 
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Figure 5. Distributions of Nr and Nj parameters that best adjust synthetic data sets generated 
by the bootstrap technique for the 6 Li + 80 Se system. The analysis based on the ellipses is 
described in section 3.3. The uncertainty bars indicate the medium values of the parameter 
distribution and their standard deviations. 





















4. Conclusions 

We have shown that most studies use the standard rule from curve fitting: x 2 < Xo + 1 (eq. 
ED, to determine the uncertainty in fitting parameters (usually Nr and Nj) from experimental 
data, regardless of their experimental value of Xo/ l/ - This is not satisfactory even from the point 
of view of conventional statistic: For the cases where Xo/ u > 1 that prescription is incorrect 
and should be replaced by x 2 < Xo + 2.3xo /v of eq. llOdl Parameters uncertainties which has 
been already derived using the x 2 < Xo + * recipe , can be easily scaled up (under the parabolic 
approximation of eq. ED by a factor of ^/2.3xo/ y - 

The bootstrap resampling method applied in this work produced a more realistic distribution 
of the parameters as shown in Figs. El b) and c). The resulting uncertainties are similar or 
somewhat larger than the ones obtained with the <74 ellipse (eq. llOdl) . 

To judge the kind of TA it is very helpful to look at the series of 2-dim Nr vs. Nj plots 
with their respective uncertainty ellipses. In this way, the correlation between the parameters 
can be considered. In Fig. [Hour results, plotted in the conventional way, show a more reliable 
estimation of the parameter uncertainties than the quoted in the original works (smaller for 12 C 
_l_ 208 p^ similar or slightly larger for 6 Li + 80 Se). In these cases, however, the conclusions about 
the kind of TA was not modified. Further work is in progress to extend the present analysis to 
other systems, using bootstrap as well as other resampling techniques. 
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